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ABILITY FACTORS AND COMPONENT PERFORMANCE 
MEASURES AS PREDICTORS OF COMPLEX 
TRACKING BEHAVIOR’ 


JAMES F. PARKER, JR. 


Psychological Research Associates, Inc. 


HE present study investigates the rela- 
between ability variables and 
progress in learning a complex perceptual- 
motor skill. It represents an extension of 
previous research in which ability patterns 
at early and advanced performance levels in 
psychomotor tasks have been compared 
with a view to establishing the kinds of 
abilities and measures most predictive of 
higher levels of proficiency. These studies 
have implications for questions concerning 
the processes involved in learning complex 
skills as well as for problems in training 
and test development. 

The distinction between the terms 
“ability” and “skill” as used here should 
be made explicit. The term ability refers 
to a more general, stable trait of the indi- 
vidual which may facilitate performance in 
a variety of different tasks. Thus, the 
ability of spatial-visualization may be im- 
portant in such diverse activities as naviga- 
tion, dentistry, and engineering. The term 
skill is more specific: it is task oriented. 
Flying an airplane is a skill, while manual 
dexterity and spatial-visualization are more 
general abilities. Of course, abilities them- 
selves are often products of earlier learn- 


'This study was initiated in 1956 under Air 
Force Contract AF 41(657)-64 between Psy- 
chological Research Associates, Inc. and Air 
Force Personnel and Training Research Center. 
In 1958 cognizance of this contract was trans- 
ferred to the Aero Medical Laboratory, Wright 
Air Development Center. Edwin A. Fleishman 
served as Project Monitor while a member of the 
Skill Components Research Laboratory of Air 
Force Personnel and Training Research Center. 
He retained his association with the project while 
on the faculty of Yale University. Robert A. 


Seibel, Bryce O. Hartman, and Marty R. Rock- 
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ing. This view is elaborated elsewhere 
(Gagné & Fleishman, 1959). 

It has been found that for certain classes 
of perceptual-motor tasks, there are pro- 
gressive qualitative and quantitative 
changes in those abilities which contribute 
to proficiency as the task is learned. This 
has been demonstrated with a serial re- 
action task (Fleishman & Hempel, 1954a), 
a visual discrimination reaction task 
(Fleishman & Hempel, 1955), and a con- 
tinuous pursuit task (Fleishman, 1956). 
Woodrow (1938) has found the same pro- 
gressive changes to be involved in extended 
performance on printed tests. In other 
words, for those tasks proficiency at later 
stages of learning depended upon different 
combinations of abilities than did initial 
proficiency. 

The present investigation differs from 
others in this area in two major respects. 
First, the task is considerably more com- 
plex than that used in previous studies. In 
the present instance the task roughly simu- 
lated that performed by a pilot during the 
attack phase of an airborne radar intercept 
mission. Thus, the task was more “real- 
istic” and more demanding than the labora- 


way served as project monitors during the latter 
stages of the study. 

The correlation analysis and factor analysis 
procedures were accomplished under terms of a 
subcontract with Psychological Research Service, 
Inc. of Austin, Texas. They were directed by 
Benjamin Fruchter. 

The tracking devices and scoring consoles were 
designed by Henry P. Birmingham of the Naval 
Research Laboratory. 

Permission is granted for reproduction, transla- 
tion, publication, use, and disposal in whole or in 
part by or for the United States Government. 
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tory tests previously investigated. The 
second difference involved the total amount 
of learning time which was investigated. 
A limitation of previous studies has been 
the relatively short period required to 
achieve a high level of proficiency. In the 
present study subjects were trained for 17 
sessions distributed over 1 to 1.5 months. 

The increased complexity of the present 
task raises the question of whether new 
kinds of abilities are required and whether 
the patterning of these abilities is different 
from that found with previous tasks. For 
example, the introduction of complexity of 
function may demand certain skills of in- 
tegration and coordination not previously 
required. 

A primary purpose of this study, as 
stated above, was to specify the abilities 
underlying terminal proficiency on a com- 
plex control task and to identify the man- 
ner in which the contribution of these 
abilities to proficiency changes during the 
course of learning. Another important ob- 
jective was to compare the predictability 
of terminal performance from external 
measures with predictions from measures 
taken earlier in practice on the task itself. 
In a previous study (Fleishman & Hempel, 
1954a) it was found that advanced per- 
formance on a psychomotor task, the Com- 
plex Coordination Test, was better pre- 
dicted from a combination of printed and 
apparatus tests than from early scores 
taken on the task itself. This study pre- 
sented an opportunity to test the generality 
of this finding in a more complex task situ- 
ation. 


PROCEDURES 


Data Gathering 


The experimental procedures followed in this 
study are similar to those used in previous studies 
in this series. Subjects were first administered 
a large reference battery of printed and psycho- 
motor apparatus tests. Following this the same 
subjects spent a number of sessions mastering the 
criterion task. Performance measures were taken 
at the various stages of practice on this task. 
Correlations among scores on both the reference 
battery and the stages of learning of the criterion 
task were obtained and factor techniques applied. 
The factors were defined from the loadings of the 
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reference tests. Loadings of the various stages of 
practice of the criterion task on the factors de- 
fined by the reference tests specify the changes in 


the factor pattern of this task as practice con-| 


tinues. 


Subjects 


The subjects were 203 freshman and sophomore 
Air Force ROTC students at the University of 
Maryland. No subject had had pilot training of 
any kind. Each subject was paid for his partici- 
pation in this study. 


Reference Battery 


The initial testing consisted of the administra- 
tion of a large battery of psychomotor apparatus 
and printed tests. Initially a listing was made of 
those factors which might be of importance in 
mastering a complex tracking task. This list even 
included such abilities as “Verbal Comprehension,” 
inasmuch as this ability might be of importance in 
understanding the explanation of the requirements 
of the task and thus be involved in determining 
ultimate proficiency. The majority of the refer- 
ence tests were selected in terms of their factor 
loadings on these abilities in previous investiga- 
tions. A complete listing of the hypothesized 
ability factors and the loadings of the various 
tests on these factors is presented in Appendix A. 
The test battery consisted of 23 apparatus and 21 
printed tests. Fifty different scores were pro- 
vided by this battery. 

Total time for the administration of this battery 
was 11 hours. This was divided into three 2-hour 
sessions for the administration of the printed tests 
and five 1-hour sessions for the administration of 
the apparatus tests. Two models of each apparatus 
test allowed for the testing of subjects in pairs. 
A complete listing of the tests comprising the 
reference battery is presented in Table 1. This 
table also presents reliability coefficients for each 
test in the battery. Appendix B presents drawings 
of the apparatus tests and descriptions of all tests, 
both printed and apparatus. 


Criterion Task 


Subject Task. The criterion task consisted of 
a tracing device constructed so as to simulate 
roughly the display characteristics and control 
requirements of an airborne radar intercept mis- 
sion. The task of the subject was to maintain the 
target dot at the center of the oscillograph display, 
while at the same time nulling a sideslip indicator. 
That is, the subject envisoned himself to be flying 
the attack phase of an airborne radar intercept 
mission. Thus, if the target was to the right, the 
subject made appropriate control movements to 
steer the craft to the right. These movements 
would bring him “on target” and the dot would 
return to the center of the display. All turning 
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PREDICTORS OF COMPLEX TRACKING BEHAVIOR 


TABLE 1 


PRINTED AND APPARATUS TESTS COMPRISING REFERENCE BATTERY 


Test Test Reliability* 
Printed 
1. Aerial Orientation 84 
2. Complex Movements -85 
3. Coordinate Movements -70 
4. Directional Control 
5. Discrimination Reaction Time .87 
6. Following Directions Py 
7. Forced Landings .88-.91 
8. Formation Visualization .76 
9. General Mechanics .88 
10. Instrument Comprehension 92 
11. Mechanical Comprehension .82 
12. Pattern Comprehension -76 
13. Planning a Course 81 
14. Signal Interpretation 347 
15. Spatial Orientation .69 
16. Speed of Identification .74 
17. Stick and Rudder Orientation .74 
18. Verbal Comprehension (Vocabulary) -90 
(50) Verbal Comprehension (Background for Current Affairs) .87 
19. Visual Pursuit .80 
20. Visualization of Maneuvers .87 
Apparatus 
21. O'Connor Finger Dexterity -76 
22. Purdue Pegboard (Summation Score) .90> 
23. Minnesota Rate of Manipulation (Placing) -87 
24. Minnesota Rate of Manipulation (Turning) 79 
25. Two-Plate Tapping .99 
26. Precision Steadiness (Errors) -90 
27. Direction Control (Corrects) .90-.95 
28. Control Sensitivity .94¢ 
29. Ten Target Aiming (Errors) .94 
30. Ten Target Aiming (Corrects) 91 
31. Bimanual Matching 
32. Track Tracing (Errors) 91 
33. Two-Hand Coordination .89—.938 
34. Choice Reaction Time 68° 
35. Complex Coordinator .85-.95 
36. Pursuit Confusion (Errors) .90 
37. Pursuit Confusion (Corrects) .88 
38. Motor Judgment 56° 
39. Discrimination Reaction Time .87-.96 
40. Rotary Pursuit .92-.97 
41. Visual Reaction Time .86 
42. Auditory Reaction Time 85 
43. Jump Visual Reaction Time .88 
44. Jump Auditory Reaction Time .88 
45. Steadiness Aiming .84 
46. Single-Dimension Pursuit .84—.92 
47. Rate Control .89 
48. Rotary Aiming -96 
49. Rudder Control -90-.92 


® Reliabilities for those tests not 1 Sommmened directly from data of this study are taken from the following: Fleishman (1958b) 
Guilford and Lacey (1947), Roff (1951). 
b Based on average reliability of the four subparts of this test and corrected for an increase in length by a factor of four. 


¢« Computed using data of this study (split-half), 
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movements required coordinated action of stick 
and rudder controls. 

Three identical tracking devices were con- 
structed especially for purposes of this study and 
are shown in Figures 1 and 2. A block diagram?” 
is presented in Appendix C. These devices and 
related scoring consoles allowed for the testing of 
from one to three subjects simultaneously under 
the control of a single test administrator. 


2 Complete schematics of all components are 
presented in Wright Air Development Center Re- 
port TR 59-255. 


Fic. 1. Photograph of tracking facility show- 
ing three tracking devices, computer programer, 
and scoring console. 


Fic. 2. Photograph of tracking device. 
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Each subject was given a brief indoctrination 
into the nature of the task and the action of the 
control system. He was then allowed 5 to 10 
seconds of practice. Following this, through the 
remainder of the training program, there was no 
formal guidance of any sort. Each subject learned 
the task on his own. However, all questions of 
subjects related to the operation of the system 
were answered. Each subject was told his inte- 
grated error score following every trial. 

Displays. The subject’s instrument panel con- 
tained two displays. The first consisted of a tar- 
get dot presented on a cathode ray oscillograph. 
The target course was generated by setting the 
equation of a swinging pendulum into an analog 
computer. This produced a sine wave with a 
frequency of approximately 6 cycles per minute 
in the horizontal coordinate as the target course. 
The rate of decay in amplitude was approximately 
5% per cycle. However, the dynamic characteris- 
tics of the over-all task were such that subjects 
neither perceived this drop in amplitude nor the 
fact that the target was programed in one co- 
ordinate only. Any control imbalances resulted in 
dot excursions of considerably larger magnitude 
than those provided by target programing. 

Beneath the oscillograph was an inverted 3- 
inch, zero-centered voltmeter termed a “sideslip 
indicator.” This meter reading indicated to the 
subject a “lack of coordination” in control actions 
when centering the target dot. This indicator did 
not constitute an independent task but rather pro- 
vided the subject with additional information re- 
lated to the primary task, 

Control System. In performing this task sub- 
jects used a standard aircraft control system in- 
volving a control stick and rudder pedals. These 
controls were coupled in a manner similar to those 
of an actual aircraft. Thus, application of right 
control stick pressure without proper amount of 
right rudder produced a sideslip to the left and a 
consequent left deflection on the sideslip indicator. 

Control of the target dot in elevation was ac- 
complished by forward and backward movements 
of the control stick. This was a pure second-order 
system resulting from the use of two cascaded in- 
tegrators in the linkage between the control and 
display. Thus the acceleration of the target dot 
was directly proportional to stick displacement. 

Control of the target dot in azimuth was accom- 
plished by right and left movements of the control 
stick. This comprised a system involving accelera- 
tion control plus an exponential lag network. This 
dimension was mechanized using three cascaded 
integrators with a negative feedback loop around 
one. The time constant of this lag network is 1 
second; that is, it requires 1 second to achieve 
approximately two-thirds (1-1/e) of the final 
signal resulting from a given stick displacement. 

Control of the target dot in azimuth (envisoned 
as turning the aircraft) and centering the side- 
slip indicator (coordination display) were both 
effected by rudder pedal displacement as well as 
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by the control stick. This rudder control of the 
sideslip indicator involves a simple lag network. 
Thus, the sideslip indicator displacement was di- 
rectly proportional to rudder pedal displacement. 
Movement of the sideslip indicator by stick action 
represents a velocity control operating through 
two exponential lag networks. 

Movement of the target dot by rudder pedal 
displacement approximates a pure velocity control. 

Criterion Scores. The following five perform- 
ance measures were obtained during each testing 
session. Four of these were error scores; one was 
a time-on-target score. The error scores represent 
the extent of target dot (or indicator needle) dis- 
placement from the null position in one dimension 
summated through time. 

1. Integrated absolute error score. This was 
recorded at the conclusion of every trial and was 
produced by summing algebraically the three 
absolute error part scores described below in ac- 
cordance with this relationship: 


T =1/2X+1/2Y+Z [1] 


Where T = Integrated absolute error score 
X = Absolute azimuth error 
Y = Absolute elevation error 
Z =Sideslip error 

The double weight for the sideslip error was 
introduced on the basis of pretest results in which 
it was noted that some subjects neglected rudder 
pedals altogether and used only the stick to con- 
trol the dot. The increased weight made a good 
total score more dependent upon proper rudder 
pedal use. 

Each of the following part scores was recorded 
every third trial. An automatic sequencing 
mechanism switched from one part score to the 
next at the conclusion of each trial. 

2. Azimuth (yaw) part score. This is a summa- 
tion of the total error occurring in the horizontal 
axis of the oscillograph display. 

3. Elevation (pitch) part score. This is a sum- 
mation of the total error occurring in the vertical 
axis of the display. 


4. Sideslip error part score. This is a measure 
of the lack of coordination between stick and 
rudder movements. 

5. Time-on-target score. This score represents 
the time during the trial when the target dot 
and the sideslip indicator needle are both (simul- 
taneously) within prescribed tolerance limits. 

The time-on-target area consisted of a diamond- 
shaped area (a tilted square) in the center of the 
oscillograph. This area was not demarked for 
benefit of the subject. Distance from the center 
of the oscillograph to any corner of the square 
was 1 inch. Sideslip error also entered into the 
calculation of time-on-target. Sideslip tolerance 
was = 0.5-inch needle displacement from cen- 
ter. Thus, if a subject approached the tolerance 
limit in the X axis of the scope display, a slight 
deflection of the sideslip indicator would throw 
him out of tolerance. 


Data Analysis 
Reference Test Scores 


From each test, the obtained distributions of 
raw scores were transformed to normalized distri- 
butions of standard scores (stanines), each with 
a range from 1 to 9, a mean of 5, and a stand- 
ard deviation of 2. Conversions were made so 
that the 9 end of the scale was always indica- 
tive of good performance. 


Tracking Performance 


Each of the 17 practice sessions for the criterion 
tracking task consisted of 21 1-minute trials, 
making a total of 357 trials. 

The problem of deciding on the size of the 
time segment to be sampled from these trials in- 
volved the following considerations. It was neces- 
sary to have each segment large enough to be 
sufficiently reliable; at the same time, it was de- 
sired to keep the segment small enough to provide 


TABLE 2 


RELIABILITIES OF THE VARIOUS MEASURES OF TRACKING PERFORMANCE AT THREE STAGES 
DURING THE LEARNING PERIOD 


Integrated Horizontal Vertical Sideslip Time-on- 
Error Error Error Error Target 
Early Stage .83 64 60 .63 .58 
(Segment 1-Segment 2) 
Intermediate Stage 87 -67 -68 
(Segment 25-Segment 26) 
Final Stage .89 .96 .89 


(Segment 50-Segment 51) 


Note.—All correlations based on 203 cases. 
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as precise as possible a definition of the learning 
curve. Thus, use of an entire session as a segment 
might be highly reliable but changes occurring 
during the session might be obscured. 

For each session, scores of the first three trials 
were discarded in order to avoid problems of 
warm-up effect. The remaining 18 trials of each 
session were then subdivided into three groups of 
six trials each. Each group of six trials was 
designated “time segment” of performance. There 
were thus 51 time segments obtained through the 
full period of practice. For each of the over-all 
measures of performance (integrated error score 
and time-on-target score) one time segment repre- 
sents 6 minutes of performance. For each of the 
part scores (elevation, azimuth, and_ sideslip 
error), a time segment represents 2 minutes of 
performance, a part score being recorded on every 
third trial only. Table 2 presents reliability co- 
efficients for each measure of performance at an 
initial, intermediate, and terminal stage of learn- 
ing. These coefficients represent the correlation of 
adjacent time segments. 


Learning Curves. Figures 3 through 7 present 
the learning curves for the five measures of track- 
ing performance. All error learning curves are 
similar except that shown in Figure 7 for sideslip 
(coordination) error. This error curve shows 
little improvement until about Segment 15. This 
reflects the fact that many subjects did not use 
the rudder pedals to any great extent during in- 
itial practice sessions. It appears that although 
subjects understand the requirements of this task, 
they will not attempt to time-share stick and 
rudder controls until they have attained some skill 
in using the stick control. The time-on-target 
curve differs from the others in that it is sig- 
moidal rather than exponential. This is because 
the time-on-target represents a poor measure of 
performance at the extremes when the subject 
either is continuously out of or continuously in 
tolerance. The error scores do not suffer in this 
respect. 
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Fic. 3. Performance curve based on integrated 
absolute error measure. 
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Fic. 4. Performance curve based on time-on- 
target measure. 
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Fic. 5. Performance curve based on azimuth 
error measure. 
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Fic. 6. Performance curve based on elevation 
error measure. 
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SIDESLIP ERROR 
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Fic. 7. Performance curve based on sideslip 
(coordination) error measure. 


Figures 3 through 7 illustrate group perform- 
ance and present relatively stable curves. There 
was, however, considerable variation among in- 
dividuals with respect to performance on this task. 
Figure 8 presents performance curves based on 
integrated error score for three subjects. These 
curves were selected to illustrate the extent of in- 
dividual differences both in rate of learning and 
in terminal proficiency. Subject A, for example, 
is the poorest initially but rapidly improves to a 
high level of proficiency. Subject B improves 
slowly and erratically throughout the period of 
practice, although initially he is better than Sub- 
ject A. Subject C shows relatively little im- 
provement at any time. 


— \ SUBJECT A —_. 
V 
g A 
\ | V\\ 
© 1000 | / 


° 5 10 15 20 25 30 35 40 45 50 
TIME SEGMENTS OF PRACTICE 


Fic. 8. Curves of three selected subjects illus- 
trating the extent of individual variation in per- 
formance. 


Selection of Practice Stages for Factor 
Analysis. It was decided that 10 stages of prac- 
tice would be used in the subsequent factor 


analysis as a basis for determining the changes 
in underlying ability patterns during the learning 
of this task. The selection of the appropriate 10 
stages of practice was accomplished before it was 
possible to compute the mean scores for the entire 


™N 


sample of 203 subjects. For this purpose data 
from a random sample of 25 subjects were chosen, 
and a curve using integrated error score as a 
measure of performance was generated. Figure 9 
presents this curve and indicates the 10 stages of 
practice which were selected for inclusion in the 
final data analyses. Points were selected in a man- 
ner it was felt would maximally define critical 
periods during the learning process. All perform- 
ance measures at each of these 10 practice stages 
next were converted into stanine form for fur- 
ther analyses. 
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Fic. 9. Curve based on integrated error score 
of 25 randomly selected subjects showing selection 
of 10 stages of performance. 


Correlational Analyses 


Following the transformation of all refer- 
ence test scores and criterion measures into 
stanine form, subsequent data analyses were ac- 
complished through use of the ORDVAC high- 
speed digital computer. Appendix D presents the 
matrix of intercorrelations among all printed and 
apparatus tests of the reference battery. Appen- 
dix E presents intercorrelations between reference 
tests and performance measures of the tracking 
task. Appendix F presents intercorrelations be- 
tween and within total scores and component 
scores taken from the task itself. 

The matrix of intercorrelations of reference 
tests was factor analyzed using a digital computer 
program yielding a principal solution. 
Fifteen factors were extracted by this method. 
Appendix G presents the unrotated factor load- 
ings for tests in the reference battery. Orthogonal 
rotations of the reference axes were made, using 
the graphical method of Zimmerman (1946). The 
correlations of performance scores (integrated 
absolute error) with the reference test scores next 
were used in projecting performance measures 
onto the rotated axes defined by the reference bat- 
tery. The procedure used was Mosier’s extension 
method as described by Fruchter (1954). Appendix 
H presents the rotated factor loadings of all 
reference test scores and measures of perform- 
ance. 
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RESULTS 


Interpretation of Factors in the Reference 
Battery 


This section describes the interpretation 
of the 15 rotated factors extracted from 
the 50 reference tests. Test variables with 
the highest loadings are listed for each 
factor. 


Factor 1—Spatial Orientation. The first 
three tests listed below have served as 
reference tests of Spatial Orientation in 
many previous analyses (see, particularly, 
the review by Michael, Guilford, Fruchter, 
& Zimmerman, 1957; and studies by Roff, 
1951, and by Fleishman, 1957b). This 
factor is defined as representing the ability 
to comprehend the arrangement of a visual 
stimulus pattern, primarily with respect to 
the subject’s body as the frame of refer- 
ence. Tests of this factor often ask: 
“What position am I in, if the situation 
looks like this?” (or vice versa). 


No. Variable Loading 
17 Stick and Rudder Orientation ao 

1 Aerial Orientation se 
10 Instrument Comprehension 47 
47 Rate Control 47 
20 Visualization of Maneuvers .46 
14 Signal Interpretation -45 
Factor Il—Control Precision. This 


factor involves the ability to make sensi- 
tive, highly controlled (but not overcon- 
trolled) positioning adjustments, primarily 
where larger muscle groups are involved. 
These adjustments are made in response 
to visual stimuli. This factor has been 
called Psychomotor Coordination 
(Fleishman & Hempel, 1956) and Fine 
Control Sensitivity (Fleishman, 1958b) in 
earlier studies, but the present label is 
more consistent with later interpretations. 


No. Variable Loading 
40 Rotary Pursuit .60 
25 Two-Plate Tapping 41 
49 Rudder Control -40 
28 Control Sensitivity .38 
37 Pursuit Confusion (Corrects) .38 
36 Pursuit Confusion (Errors) BF 


31 Bimanual Matching oe 
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Factor I1l—Speed of Arm Movement. 
This factor is restricted to those tasks in 
the battery which have previously identi- 
fied a Speed of Arm Movement Factor 
(Fleishman, 1954, 1957b, 1958b; Fleish- 
man & Hempel, 1954a, 1955). This repre- 
sents simply the speed with which a sub- 


ject can make a discrete, gross arm 

movement. 
No. Variable Loading 
29 Ten Target Aiming (Errors) -63 
30 Ten Target Aiming (Corrects) .50 
43 Jump Visual Reaction Time .36 
44 Jump Auditory Reaction Time 31 
Factor I’—Manual Dexterity. This 


represents the ability to make skillful, con- 
trolled arm-hand manipulations of larger 
objects (Fleishman, 1953, 1954; Fleish- 
man & Hempel, 1954b; Hempel & Fleish- 
man, 1954). 


No. Variable Loading 
30 Ten Target Aiming (Corrects) -42 
24 Rate of Manipulation (Turning)  .40 
23 Rate of Manipulation (Placing) 38 
29 Ten Target Aiming (Errors) a 
25 Two-Plate Tapping 


Factor V—Reaction Time. This factor 
contains all the simple reaction time tests 
in the battery. It is defined simply as the 
speed with which the subject can react to 
a stimulus when it appears (Fleishman, 
1954, 1958b; Fleishman & Hempel, 1955). 


No. Variable Loading 
43 Jump Visual Reaction Time mF 
42 Auditory Reaction Time 1 
41 Visual Reaction Time -48 
44 Jump Auditory Reaction Time -48 


Factor VI—Verbal Comprehension. This 
factor is defined as representing knowledge 
and understanding of the English language 
(French, 1951). 


No. Variable Loading 
18 Vocabulary .67 
50 Background for Current Afiairs .67 
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Factor VII—Response Orientation. This 
factor is defined as the ability to choose 
and perform the proper movement or di- 
rection of movement from several alter- 
natives. The factor does not involve the 
interpretation of the spatial characteristics 
of the stimulus (Fleishman, 1957a, 1957b, 
1958b; Fleishman & Hempel, 1956). 


No. Variable Loading 
34 Choice Reaction Time .39 
5 Discrimination Reaction Time 
(printed) .38 
7 Forced Landings .36 
14 Signal Interpretation .30 


Factor VIII—Arm-Hand Steadiness. 
This factor involves the ability to make pre- 
cise, steady arm-hand movements of the 
type which minimize strength and speed. 
This ability is involved in tasks requiring 
maintenance of a steady arm position in 
space where the crucial feature is a mini- 
mum of tremor, as well as in tasks involv- 
ing steadiness during limb movements 
(Fleishman, 1953, 1954, 1958a, 1958b; 
Hempel & Fleishman 1954). 


No. Variable Loading 
32 Track Tracing (Errors) -42 
45 Steadiness Aiming .40 
26 Precision Steadiness (Errors) .34 


Factor IX—Perceptual Speed. This 
factor involves the ability to make rapid 
comparisons of visual detail (Fleishman, 
1956; French, 1951; Guilford & Lacey, 
1947). 


No. Variable Loading 
16 Speed of Identification Be 
19 Visual Pursuit 

6 Following Directions “ou 
16 Spatial Orientation .30 


Factor X—Visualization. This factor in- 
volves the ability to mentally manipulate 
visual images. Tests of the factor require 
that one move, turn, twist, or rotate (in 
imagination) one or more parts of a con- 
figuration in a certain specified sequence. 
The subject is required to recognize the 
new appearance, position, or location after 


the prescribed manipulations. (Fleishman, 
1957b; Michael et al., 1957; Roff, 1951). 


No. Variable Loading 
8 Formation Visualization 61 
12 Pattern Comprehension .58 
17 Stick and Rudder Orientation .57 
20 Visualization of Maneuvers AT 


Factor XI—Integration. This factor has 
been defined as the ability to utilize and 
coordinate a number of disparate cues and 
activities quickly and accurately in order 
to produce an appropriate integrated single 
response (Fleishman & Hempel, 1956; 
Guilford & Lacey, 1947). While these 
printed tests involve such responses, the 
absence of the apparatus tests indicates that 
a redefinition of this factor may be neces- 
sary. 


No. Variable Loading 
3 Coordinate Movements -40 
2 Complex Movements .30 
4 Directional Control (printed) 30 


Factor XII—Pursuit Confusion Doublet. 
This factor is restricted to two scores on 
the Pursuit Confusion Test and is, hence, 
not interpretable in more general terms. 
The two scores were not expected to define 
the same factor (Fleishman, 1958b). 


No. Variable Loading 
37 Pursuit Confusion (Corrects) 35 
36 Pursuit Confusion (Errors) ai 


Factor XIII—Mechanical Experience. 
This factor primarily involves a knowledge 
of tools and an understanding of mechani- 
cal principles and the proper use of tools 
and mechanical devices (French, 1951; 
Guilford & Lacey, 1947). 


No. Variable Loading 
9 General Mechanics 47 
11 Mechanical Comprehension 47 
7 Forced Landings a 


Factor XIV—Finger Dexterity. This 
factor involves the ability to make rapid, 
skillful, controlled manipulative move- 
ments of small objects where the fingers 
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are involved, primarily (Fleishman, 1953, 
1954; Fleishman & Hempel, 1955; Hempel 
& Fleishman, 1954). 


No. Variable Loading 
21 O'Connor Finger Dexterity .49 
22 Purdue Pegboard 43 
23 Rate of Manipulation 36 
Factor XV—Multilimb Coordination. 


This factor is common to tasks in which 
the requirement is the simultaneous use of 
both hands, both feet, or hands and feet. 
These tests have defined this factor in pre- 
vious studies (Fleishman, 1958b; Fleishman 
& Hempel, 1956). 


No. Variable Loading 
49 Rudder Control -40 
35 Complex Coordination Test .38 
33 Two-Hand Coordination .30 


Relation of Ability Factors to Stages of 
Practice in Tracking 


This study was concerned with determin- 
ing the kinds of basic psychomotor abilities 
underlying tracking proficiency and with 
the manner in which these abilities change 
as a function of practice. Figure 10 illus- 
trates the extent to which the combined 
abilities account for variability in track- 
ing performance at the various stages 
of learning. It will be noted that only 
in the terminal stages do these abilities 


account for as much as 25% of the 
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Fic. 10. Percentage of variance in tracking 
performance accounted for by all identified fac- 
tors. 
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variance. ligure 10 clearly indicates that 
the set of abilities defined by the refer- 
ence battery in the present study does not 
account for any substantial portion of the 
variance in tracking performance. This is 
in contrast to previous studies with other 
psychomotor tasks. For example, in the 
case of the Complex Coordination Test up 
to 75% of the variance was accounted for 
by independent reference ability measures 
(Fleishman & Hempel, 1954a); over 50% 
was accounted for in the Discrimination 
Reaction Time Test (Fleishman & Hempel, 
1955); roughly 60% in the two-hand and 
unidimensional matching and plane control 
tasks (Fleishman, 1957a). 

Consideration next was given to the 
nature of the changes occurring during 
practice in those abilities which do show 
some relation to tracking performance. 
Based on integrated error score as a 
measure of performance, only Factors I 
(Spatial Orientation), VII (Responsé 
Orientation), XII (Pursuit Confusion), 
and XV _ (Multilimb Coordination) had 
factor loadings in excess of .20 at any stage 
of practice. Of these, only Spatial Orienta- 
tion and Multilimb Coordination show sys- 
tematic changes in importance during the 
course of practice. Figure 11 presents 
curves illustrating changes in the _per- 
centage of variance accounted for by these 
two abilities with increased practice. Multi- 
limb Coordination shows an increase in 
importance during the course of learning 
while Spatial Orientation appears to be 
important only during the middle stages. 
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of two ability factors with increased practice in 
tracking. 
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Consideration was given to the possibility 
that use of only 6 minutes of performance 
in the integrated error criterion measure 
might not have been a sufficient behavior 
sample and might have lowered the corre- 
lations obtained between performance and 
reference tests. Certainly use of an ex- 
panded measure of performance would in- 
crease the reliability of this measure even 
though it had previously been found to be 
sufficiently high (.89 at the terminal prac- 
tice stage). In order to examine this possi- 
bility, several correlations between inte- 
grated error and three of the reference 
tests at the three stages of practice were 
recomputed, using a 21-minute perform- 
ance measure rather than a _ 6-minute 
measure. Table 3 presents both sets of 
correlations. It does not appear from the 
changes in the correlation coefficients that 
any significant increase would have been 
obtained by using an expanded measure of 
performance. 


Relationships among Component Perform- 
ance Measures 


It will be recalled that, at each of the 
practice stages, five measures of perform- 
ance were obtained. These measures were: 

1. Integrated absolute error 

2. Azimuth (X) error 

3. Elevation (Y) error 

4. Sideslip (Z) error 


5. Time-on-target (scope and _ sideslip 
simultaneously ) 

The integrated absolute error score is not 
an independent measure but is determined 
by the X, Y, and Z scores in accordance 
with the relationship described previously 
in Equation 1. 

The above performance measures were 
obtained primarily with a view to answer- 
ing the question: “For this type of task, 
how well do component performance 
measures predict terminal proficiency?” 
Table 4 presents the intercorrelations of all 
performance measures at an initial point in 
learning (first time segment) and at an 
intermediate point (twenty-fifth time seg- 
ment).* The table also presents the corre- 
lations of all measures, at each of these 
stages, with terminal proficiency (fiftieth 
time segment) as measured by the inte- 
grated error score. It is apparent that in- 
itially all component measures are uncorre- 
lated with terminal proficiency. In other 
words, neither initial component measures 
nor over-all measures allow the prediction 
of final performance in this task. At an 
intermediate point in the learning period, 
component measures do show some rela- 
tion to the final score (X = .28, Y = .36, 
Z = .34) but none is sufficiently high to 
serve as a very useful predictor. 


%It will be recalled that the full course of 
practice was broken into 51 time segments. 


TABLE 3 


CORRELATIONS BETWEEN SELECTED REFERENCE TESTS AND A MEASURE OF PERFORMANCE 
ILLUSTRATING THE EFFECT OF EXPANDING THE MEASURE OF PERFORMANCE 


Correlations 


Previous* Expanded 

Aerial Orientation—Session 5 35 .25 
Discrimination Reaction Time (Printed)—Session 5 .22 25 
Complex Coordinator—Session 5 24 
Aerial Orientation—Session 9 
Discrimination Reaction Time (Printed)—Session 9 18 .17 
Complex Coordinator—Session 9 
Aerial Orientation—Session 17 .18 .09 
Discrimination Reaction Time (Printed)—Session 17 .09 .12 

13 44 


Complex Coordinator—Session 17 


* The performance measure (integrated absolute error) entering this correlation is a 6-trial “time segment.”” This time segment 
in each case forms a part of the 21-trial session which represents the expanded measure, 
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TABLE 4 


INTERCORRELATIONS AMONG COMPONENT PERFORMANCE MEASURES AND A FINAL 
PROFICIENCY MEASURE 


Final 
Integrated X Error Y Error Z Error Time-on- Integrated 
Error Target Error 
TIME SEGMENT 1 
Integrated Error .25 -60 .35* -04 
X Error — .05 -02 
Y Error —.16 31 -08 
Z Error —.01 -12 
Time-on-Target — .02 
TIME SEGMENT 25 
Integrated Error .65 .63 .92 -46 
X Error .68 .02 -64 .28 
Y Error .27 -68 -36 
Z Error 58 34 
Time-on-Target -48 


* The fact that time-on-target scores are not negatively correlated with the error scores is due to the process of converting raw 
scores to stanine form, At this time all score distributions were arranged so that high score was indicative of good performance. 


DISCUSSION 


The rationale underlying this study is 
that there exists within the population 
under inquiry a finite number of abilities 
which are used in mastering a complex 
tracking task. These abilities are represent- 
ative of the class of theoretical construct 
which is response inferred. They are re- 
sponse inferred in that, although the 
characteristics of the task remain un- 
changed, the performance of individuals 
exhibits major variation. The purpose of 
this study was to identify these abilities in 
terms of relations among the various per- 
formance measures (reference battery). 
Variability in performance at different 
stages of mastering the tracking task then 
could be accounted for in terms of the 
identified abilities. The validity of such 
ability identification is attested to by the 
factorial invariance found in previous 
studies using different reference tests (see 
Appendix A). The present study confirms 
this invariance using different subjects and 
a different combination of tests. 


If tracking performance in fact can be 
accounted for in terms of a limited number 
of measurable human abilities, the results 
will have implication for such areas as 


human engineering design of equipment, 
personnel measurement and selection, and 
the identification of an efficient set of learn- 
ing principles designed to improve training 
in tracking procedures. 

Initially it might be well to indicate the 
rationale behind this study and the manner 
in which this study relates to the broad 
area of tracking research. Adams (1961) 
indicates that there exist two major kinds 
of tracking research. Engineering psy- 
chologists have used the theory of closed- 
loop servomechanisms as a model for 
investigating the man-machine tracking 
system. Adams points out the advan- 
tages and disadvantages of this orien- 
tation and notes that it results in research 
oriented toward task variables. Thus, sys- 
tem input-output relations are discussed in 
terms of time and frequency characteristics 
and are described through output errors re- 
sulting as a function of changes in system 
parameters. Such changes might be per- 
formed on the input signal, control system 
dynamics, or the control-error display re- 
lationships. 

General experimental psychology, on the 
other hand, has used traditional behavior 
theory as its model and the tracking sys- 
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tem becomes a means of eliciting desired 
behavior classes. Such research is oriented 
toward procedural variables related to 
training, retention, stress, fatigue, motiva- 
tion, etc. The major deficiency in this type 
of research is that apparently any task is 
considered appropriate if it elicits the de- 
sired response class. Little consideration is 
given to possible interactions between task 
and procedural variables. 

The present investigation appears to fall 
somewhere between these two types of re- 
search. It is concerned with task variables 
to the extent of insuring a complex 
criterion task and defining the dimensions 
of complexity. These are a two-dimen- 
sional display system, control character- 
istics varying from zero-order to second- 
order, and requirement for dual-error 
nulling. Task variables were not used as 
independent variables, however. This study 
was not concerned with procedural vari- 
ables as such, yet the results have implica- 
tions for such areas as learning theory and 
training. 


Identification of Perceptual-Motor Abilities 


One major end product of this study is 
found in the identification of the ability 
factors measured by the tests within the 
reference battery. Forty-three printed and 
apparatus tests were administered to these 
subjects. (Fifty scores appeared due to 
use of subparts and correct and error 
scores as separate measures of perform- 
ance.) Although the majority of these tests 
were chosen on the basis of their factor 
loadings in previous investigations, a num- 
ber of new tests were introduced. Results 
of the factor analysis of these test intercor- 
relations serve further to define the basic 
components of human perceptual-motor 
abilities. 


Changes in Ability Patterns with Practice 


The general finding in investigations of 
this type (Fleishman, 1956, 1959) is that 
changes in the ability pattern underlying 
proficiency in the criterion task are quite 
systematic and progressive during the learn- 
ing period. For the tracking task of this 


study, however, Figure 11 indicates that 
only Factor I (Spatial Orientation) and 
Factor XV _ (Multilimb Coordination) 
show a systematic relation to tracking per- 
formance during the course of practice. 
Apparently, early in practice the ability to 
interpret the visual display characteristics 
is of some importance. Later the ability to 
balance and to coordinate the activity of 
hands and feet in manipulating the control 
stick and rudder pedals plays some part in 
determining the proficiency of the subject. 
This is in keeping with the observation 
during the testing program that most sub- 
jects experienced extreme difficulty in 
effecting coordinated movements during 
the early part of the training program. 

The Multilimb Coordination factor be- 
gins its major increase in importance at 
approximately the fifteenth time segment 
(Figure 11). This is roughly the same 
period when the sideslip (Z) error score, 
which reflects coordinated hand-foot 
activity, begins to show considerable im- 
provement (Figure 7). There are thus two 
independent analyses in support of each 
other. An identified ability factor and a 
measure of component task activity both 
indicate the importance of coordination be- 
tween limbs in determining proficiency at 
a given point in the practice schedule. 


Predictability of Tracking Performance 


One basic problem for consideration with 
any complex activity is whether terminal 
proficiency is better predicted by a set of 
external measures or by scores taken from 
initial practice periods in the activity itself. 
With the present tracking task there is no 
correlation between initial tracking per- 
formance and terminal performance. (The 
correlation between first-segment integrated 
error scores and fiftieth, or final, integrated 
error scores is .04). Based on the first time 
segment intercorrelations shown in Table 
4, a multiple correlation analysis was per- 
formed. Results of this analysis indicate 
the extent to which terminal performance 
is predictable through use of the five per- 
formance measures taken during the initial 
practice session. The obtained multiple cor- 
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relation coefficient is .17, which is not sta- 
tistically significant. In other words, scores 
obtained during initial practice periods in 
the activity itself do not predict terminal 
proficiency. It is interesting to note that 
even at the twenty-fifth time segment, 
when the subject has had approximately 4 
hours of practice in the device, the corre- 
lation of integrated error score with term- 
inal proficiency (terminal integrated error 
score) has risen only to .46. 

In opposition to the above findings there 
are six of the reference tests which show 
correlations with final tracking perform- 
ance of .26 or higher. The intercorrela- 
tions among these tests are presented in 
Table 5. The obtained multiple correla- 
tion using these tests as predictors of term- 
inal proficiency is .43, which is significant 
at the .01 level. 

These results indicate that early com- 
ponent and total scores taken from the task 
itself do not predict advanced proficiency 
levels until an intermediate stage of prac- 
tice, and these are not high. If one must 
choose between intratask and independent 
measures, selected independent measures 
will give a better prediction of advanced 
tracking proficiencv. 


TABLE 5 


RESULTS OF MULTIPLE CORRELATION ANALYSIS 
PREDICTING TERMINAL TRACKING PERFORM- 
ANCE FROM Six EXTERNAL MEASURES 


7a | 35 .25 .29 .37 .14 .26 

11 27 6.19) 2G 
39 29 
40 27 


R = .43* 


« These numbers correspond to the designation of the follow- 
ing = during the machine data analyses: 
Var. = Forced Landings 
Var. i = Mechanical Comp. 
Var. 36 = Pursuit Conf. (Err.) 
Var. 37 = Pursuit Conf. (Corr.) 
Var. “4 = Discrimination Reaction Time (Appar.) 
= Rotary Pursuit 
Var. x. Segment 50 (Terminal) Integrated Error Score 


* Significant at the .01 level (V = 203). 
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Human Performance in Tracking 


The over-all operation of tracking a 
moving target can be examined in terms of 
component responses required of the 
human being. Adams (1961) has classified 
the component responses in tracking be- 
havior into observing, predicting, and 
motor responses. These are defined below 
and are followed by a listing of those fac- 
tors identified in this study which should 
be important to each response. In some in- 
stances certain factors appear to emphasize 
elements of more than one response class. 


Observing Response. The sensing of dis- 
play parameters including both input signal 
and error signal is by the observing re- 
sponse. The observing response appears to 
involve head and/or eye movements to 
direct the visual receptors to spatially 
separated stimuli, and the discrimination of 
stimulus change. The following identified 
factors would seem to be important for the 
observing response : 


Factor I. Spatial Orientation 
Factor IX. Perceptual Speed 
Factor X. Visualization 


Prediction Response. The prediction re- 
ponse involves predictmg the regularities 
inherent in the input signal and the effect 
of control movements upon the error sig- 
nal. This implies that the subject has 
learned the dynamics of the control system 
and the interactions between control move- 
ments and display changes. Poulton 
(1957) refers to such prediction as per- 
ceptual anticipation. Perceptual anticipa- 
tion involves prediction of nature and size 
of muscular contractions required, predic- 
tion of duration of response movement, and 
prediction of future position of target at 
time of completion of response movement. 
For the criterion task of this study the fol- 
lowing factors would appear to be im- 


portant: 
Factor VII. Response Orientation 
Factor X. Visualization 
Factor XI. Integration 


The Rate Control factor, which was orig- 
inally hypothesized, would fit in this cate- 
gory. However, this factor was not identi- 
fied in the present study. 
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Motor Response. The motor responses 
are those activities involved in control sys- 
tem (stick and rudder) manipulations. It 
appears that the following abilities identi- 
fied within this study would be of impor- 
tance to such motor responses : 


Factor II. Control Precision 
Factor IIT. Speed of Arm Movement 
Factor IV. Manual Dexterity 
Factor VII. Response Orientation 


Arm-Hand Steadiness 
Integration 

Pursuit Confusion 
Finger Dexterity 
Multilimb Coordination 


Factor VIII. 
Factor XI. 

Factor XII. 
Factor XIV. 
Factor XV. 


Identification of Abilities Underlying 


Tracking Proficiency 


The preceding analysis would indicate 
that a successful tracking response is de- 
pendent upon a number of component re- 
sponses. These component responses 
would, in turn, involve certain basic “abili- 
ties.” The major objective of this study 
was to determine the extent to which a set 
of abilities as identified through use of the 
reference battery of tests accounts for 
variability in tracking performance at vari- 
ous stages in the practice schedule. The 
possibility existed that all of the factors 
listed in the preceding section would be 
important. As it turned out, this was not 
the case. As seen in Figure 10, at no stage 
of practice did these abilities, taken in their 
entirety, account for over 25% of the vari- 
ance in tracking. As seen in Figure 11, 
only two of the identified abilities show any 
systematic relation to tracking perform- 
ance. These are Spatial Orientation, listed 
under Observing Responses, and Multilimb 
Coordination, listed under Motor Re- 
sponses. However, it should be noted that 
the contribution of the observing response 
factor decreases through practice while the 
motor response factor increases in impor- 
tance. 

The major question now becomes: “Why 
were these abilities not more effective in 
accounting for variability in tracking per- 
formance?” The need for some answer be- 
comes more obvious when it is realized that 
in a previous study (Fleishman & Hempel, 


1955) using a different criterion task (the 
Discrimination Reaction Time Test— 
DRT), over 60% of criterion task per- 
formance could be accounted for at some 
practice stages using the same kinds of 
abilities as in this instance. This 60% is 
as opposed to less than 25% within this 
study. 

A possible answer may rest both with 
the nature of the tests within the reference 
battery and the nature of the criterion task. 
Considering the criterion task first, it has 
been noted that this tracking task was quite 
complex due to the dual display, the sec- 
ond-order control system characteristics, 
and the requirement for dual-error nulling. 
Another way of viewing this task might be 
that the subject was required to maintain a 
highly complicated and unstable system in 
a state of equilibrium. With tasks in- 
vestigated previously such as the DRT, 
Rotary Pursuit, and the Complex Coordi- 
nation Test, it appears reasonable that differ- 
ent abilities might be required for mastery. 
For example, with the DRT the subject ob- 
serves a visual stimulus which differs on 
successive presentations only in terms of 
four possible configurations. The subject 
reacts by pushing one of four toggle switches 
as quickly as possible. For this task it 
appears logical that such abilities as Spatial 
Orientation, Reaction Time, and Rate of 
Arm Movement would be important. 

The fact that a similar set of abilities did 
not account for a substantial amount of the 
variance in performance in the present in- 
stance may be explained if the task is ex- 
amined in light of the three required re- 
ponse areas. The observing response in 
this task requires that the subject time- 
share between two separate features of the 
over-all display. The prediction response 
requires that the subject develop the capa- 
bility of predicting target position at some 
future time. When it is considered that the 
display actually is an error signal produced 
by improper control movements, it is ap- 
parent that prediction of target position 
would require a rather complex ability. 
This is particularly true since two dimen- 
sions of the control system involved second- 
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order controls. Thus the prediction of 
target position might involve such hypo- 
thesized abilities as the ability to perform 
double- and higher-order differentiations 
while compensating for built-in control sys- 
tem lag effects. Certainly proficiency in 
this task would require a different set of 
abilities than would be found with the 
DRT or the other tasks investigated previ- 
ously. 

The particular selection of tests for the 
reference battery used in this instance 
represents an attempt to continue with the 
same type of tests used so successfully in 
previous investigations employing different 
criterion measures. The lack of success of 
this comprehensive battery of tests in de- 
fining a set of abilities which would relate 
to tracking proficiency warrants a closer 
look at the tests selected. It appears that a 
set of abilities are important with this type 
of criterion task for which appropriate 
predictive tests have not been developed. 
Further work is required for the construc- 
tion of such tests. Thus, if the criterion 
task is known to require time-sharing 
activities, the reference battery should con- 
tain tests designed to measure an hypo- 
thesized general time-sharing ability. There 
are no known reference tests which might 
be used to measure such an ability. 

In short, while the reference tests used 
in this study reaffirmed a number of basic 
human perceptual-motor abilities, these 
abilities could not be related to any con- 
siderable extent to tracking performance. 
A complex tracking activity apparently re- 
quires abilities for which appropriate 
reference measures are not available at 
present. These abilities, further, do not fall 
within the area customarily called “Motor 
Abilities.” Purely motor abilities do not 
determine individual differences in ad- 
vanced tracking proficiency. The important 
abilities appear to fall within the areas of 
“Observing Responses” and, propably to a 
greater extent, “Prediction Responses.” 
Further studies, obtaining basic measures 
within these areas, should be able to con- 
tribute additional information concerning 
the nature of a complex tracking activity. 
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SUMMARY AND CONCLUSIONS 


This investigation was designed to pro- 
vide information concerning the kinds of 
abilities which best predict performance in 
a complex tracking task. Consideration 
was given to the manner in which the un- 
derlying ability pattern exhibits change as 
a function of increasing proficiency in the 
task. The relation between early component 
performance measures and terminal pro- 
ficiency in the tracking task also was ex- 
amined. 


A battery of reference tests containing 
both apparatus and printed tests of known 
factorial structure was administered to 203 
subjects. Following this each subject spent 
a total of 17 sessions mastering the tracking 
task. Scores on the reference tests and 
various learning levels of the tracking task 
were analyzed through factor analysis tech- 
niques. Fifteen ability factors were identi- 
fied and were related to the different stages 
of practice in tracking. 

The following conclusions are drawn 
from the results of this study: 


1. The kinds of perceptual-motor abili- 
ties which previously have been found to 
be related to performance on laboratory 
criterion tasks do not account for any sub- 
stantial amount of the variance in perform- 
ance with the present task. It is hypothe- 
sized that the complexity and particular 
dynamics of the tracking task used in this 
study require different kinds of abilities. 
Such abilities as Rate of Arm Movement 
apparently are not as important to the 
mastery of complex tracking activities as 
with laboratory psychomotor tasks. In 
tracking, the important determiners of pro- 
ficiency may be found in those abilities 
used in the analysis of target motion and 
in the prediction of appropriate response 
movements, rather than in abilities related 
directly to control manipulation. 


2. Initial component and total scores 
taken from the tracking task itself do not 
predict advanced proficiency levels. If one 
must choose between intratask and inde- 
pendent measures, the independent test 
measures give a better prediction of ad- 
vanced tracking proficiency. 
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APPENDIX B 


DESCRIPTION OF TESTS IN REFERENCE BATTERY 


Printed Tests 


1. Aerial Orientation. The subject is re- 
quired to match the cockpit view of the hori- 
zon that corresponds to the airplane from 
which this view would be seen. 


2. Complex Movements. Each problem pre- 
sents a vertical line and above it a horizontal 
line. On each of these lines is a circle and a 
dot. Below the lines is a grid of 49 squares, 
one of which contains an “S.” The examinee 
indicates in the grid from the letter S the 
direction required to “move” the dots on both 
lines simultaneously into their respective 
circles. 


3. Coordinate Movements. Each problem 
presents a series of arrows which vary in 
curvature and represent different directions of 
movement. The thickness of each arrow repre- 
sents distance of movement. To the left of 
these arrows are a dot and circle. The sub- 
ject selects the one symbol (arrow) that will 
move the dot inside the circle. 


4. Directional Control. Each problem pre- 
sents nine boxes side-by-side with a target 
circle above the middle box. Also pictured is 
an arrow whose head indicates direction and 
whose length indicates distance of movement. 
The subject indicates from which box it must 
be launched to have its head reach the target. 


5. Printed Discrimination Reaction Time. 
Each item simulates a setting of the apparatus 
test of the same name except responses are 
made by pencil in one of four slots on answer 
sheets. The slots are arranged in the same 
up-down, left-right pattern as are the toggle 
switches on the apparatus version. 


6. Following Directions. Two panels of 
typical aircraft display instruments are pre- 
sented to the subject. As the subject reads 
the text he underlines certain words depend- 
ing upon relations among the instruments and 
upon directions appearing within the text. The 
test is designed to measure ability to work 
rapidly under the pressure of complex direc- 
tions. 

7. Forced Landings. Aircraft are depicted 


at certain altitudes above a number of boxes 
representing landing fields. Arrows are also 


shown on the display representing wind direc- 


tion and magnitude and up or down draft cur- 
rents. The subject must assess the situation 
and select the best landing field in terms of 
prescribed criteria. 


8. Formation Visualization. The subject is 
presented with the top and side views of 
silhouettes of aircraft flying in formation. He 
then must select the correct alternative from 
among four front views of this same formation 
flight. 


9. General Mechanics. Printed items re- 
quire practical mechanical information dealing 
with the use of operation of familiar mechani- 
cal methods and devices. 


10. Instrument Comprehension. For each 
item which presents views of cockpit instru- 
ments the subject must determine the proper 
position and orientation of an airplane. 


11. Mechanical Comprehension, The subject 
is presented drawings of mechanical devices. 
He then must answer a series of questions con- 
cerning the operation of each device. 


12. Pattern Comprehension. <A _ series of 
drawings is presented which require visualiza- 
tion of relationships between components of 
solids and their unfolded, flat projections. 


13. Planning A Course. The subject is pre- 
sented a drawing of a maze-like arrangement of 
boxes. Starting at one end the subject must 
trace his way through the boxes, responding 
to coded instructions as to direction of travel 
which are presented within the various boxes. 


14. Signal Interpretation. The subject is 
presented with a picture of a row of ships, each 
ship having an arrow beneath it. The subject 
traces from ship to ship in accordance with the 
pattern of flags being flown by each ship. Each 
problem continues until the subject returns to 
a ship used previously. 


15. Spatial Orientation. The subject is pre- 
sented with a large aerial photograph. This 
is followed by several small photographs, each 
presenting an expanded view of one section of 
the large photograph. The subject must con- 
nect each small photograph with the proper 
position within the large photograph. 
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16. Speed of Identification. Pictorial items 
are presented in which the silhouette of an 
object must be identified when it is rotated and 
imbedded in a group of similar silhouettes. 


17. Stick and Rudder Orientation. A series 
of pictures is presented to the subject show- 
ing changing views through the windscreen 
of an aircraft. The subject is required to 
recognize the corresponding change in the posi- 
tion of the aircraft and to indicate the move- 
ments of stick and rudder required to produce 
such a change. 


18. Verbal Comprenhension (Vocabulary). 
This is a typical vocabulary test requiring the 
matching of words and definitions. 


Apparatus Tests 


21. O'Connor Finger Dexterity. The sub- 
ject is required to pick up three small pins at 
a time from a tray of pins with the preferred 
hand and place them three at a time in a 
small hole. He must fill a series of small 
holes in this manner as fast as possible. Score 
is the number of pins placed. One 5-minute 
trial. 


22. Purdue Pegboard (Summation Score). 

Right hand: The subject is required to 
place a number of small pegs individually in a 
series of small holes as rapidly as possible 
with the right hand. Score is the number of 
pegs placed. One 30-second trial. 

Left hand: Same except with the left 
hand. 

Both hands: The subject is required to 
pick up two pins at a time, one with each 
hand from different trays and place them 
simultaneously in two different holes. Score 
is the number of pegs placed. One 30-second 
trial. 

Assembly: The subject is required to 
make as ‘many completed peg-washer-collar- 
washer assemblies as possible in the time al- 
lowed. Score is the number of assembly com- 
ponents completed. One 30-second trial. 

A’ summation of the four scores was 
used in the data analysis. 


AnD EDWIN A. FLEISHMAN 


(50.) Verbal Comprehension (Background for 
Current Affairs). This is an informational 
test covering current, recent, and _ historical 
events. 


19. Visual Pursuit. From a series of mazes 
or irregularly curved lines the task is to trace 
each line visually from its beginning to its 
proper termination point. 

20. Visualization of Maneuvers. A picture 
of an aircraft is presented. This is followed 
by three descriptions of changes in the aircraft 
position. The subject then selects from among 
five alternatives that picture of the airplane 
which represents its final position following 
the described maneuvers. 
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23. Minnesota Rate of Manipulation. 

Placing: The subject is required to 
place 60 cylindrical blocks in the proper holes 
as rapidly as possible. The score is the num- 
ber of blocks placed. Two 35-second trials. 

Turning: The subject is required to re- 
move the blocks from the holes with one hand, 
turn them over with the other hand, and re- 
place them in the same holes, moving from 
block to block as rapidly as possible. Score 
is the number of blocks turned. Two 40-sec- 
ond trials. 


24. Two-Plate Tapping. The subject is re- 
quired to strike two adjacent metal plates with 
a stylus as rapidly as possible. He strikes the 
plates successively; that is, first one and then 
the other, making as many taps as possible. on 
the plates in the time allowed. The number of 
taps is recorded on counters. Three 30-second 
trials. 


25. Precision Steadiness. The subject is 
seated before a long, rectangular box-like ap- 
paratus containing two openings. Each open- 
ing is the entrance to a straight passageway 
which the subject must negotiate with a long 
stylus. He moves the stylus forward at slightly 
below shoulder height and at arm’s length. 
He must move the stylus slowly and steadily 
away from his body trying not to hit the sides 
of the cylindrical passage. As he reaches the 
end of the passage he strikes a contact point 
and withdraws the stylus, again trying to avoid 
hitting any part of the passageway. He then 
negotiates the second passageway. Two com- 
plete negotiations constitute a trial. Counters 
record the number of contacts and clocks re- 
cord the number of times in contact. Six 
trials, no time limit. 
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26. Direction Control. Patterns of lights 
appear in the form of a cross (to indicate 
th- “heading” of an airplane). The pattern 
may appear in different parts of the display 
panel and may represent a small or large 
cross, depending upon the direction of head- 
ing. The examinee must use both hands con- 
currently in manipulating the proper combina- 
tion of switches or switches and buttons. A 
new aircraft appears upon proper manipula- 
tion. Four 2-minute trials. 


27. Control Sensitivity. The subject is re- 
quired to match the position of a red light 
with a corresponding green light. The position 
of the lighted green light is controlled by a 
highly sensitive control stick. A slight move- 
ment of the stick to the right displaces the 
lighted green light to the right and, similarly, 
for left movements. When the subject has 
matched the two lights and held this position 
for .5 second, the red light moves to a new 
position and the subject again proceeds to 
match it. Score is the number of completed 
matches in four 1-minute trials. 


28. Ten Target Aiming. The subject is 
seated before an upright panel containing 10 
holes arranged at equal intervals in an elliptoid 
pattern. Behind each hole can be seen a 
circular target. These targets vary in size 
from hole to hole. The subject is required to 
strike at these targets with a stylus moving 
from target to target around the pattern of 
targets in a clockwise direction. He is in- 
structed that both speed and accuracy count 
and that he must try to hit as many targets as 
possible, striking only once at a target. Error 
counts are recorded each time the subject 
strikes the outside of each hole or inside 
around the target area. Correct counts are 
scored for hits within the target area in each 
hole. Six 30-second trials. 
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29. Bimanual Matching. A red row of 
stimulus lights has a paraiiel row of green 
lights above and below it. The subject must 
match lights simultaneously in each row of 
green lights with the red lights through move- 
ments of two handles. The movements of 
each hand sometimes correspond and some- 
times are antagonistic to each other and bear 
a complex relationship to the position of the 
stimulus lights from setting to setting. Score 
is the number of simultaneous matchings made 
and held for .5 second during each of two 
2-minute trials. 


30. Track Tracing. The subject is required 
to negotiate an irregular slot pattern with a 
T-shaped stylus held at arm’s length. Score 
is the number of errors (contacts with the 
back, top, and sides of slot) during four at- 
tempts. No time limit. 


31. Two-Hand Coordination. The subject 
attempts to keep a target follower on a small 
target disc as the target moves irregularly 
and at varying rates. Movement of the target 
follower to the right and left is controlled by 
one lathe-type handle, movement to and from 
is controlled by the other. Consequently, 
simultaneous rotation of both handles moves 
the follower in any resultant direction. Score 
is the total time-on-target during four 1-min- 
ute trials. 
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32. Choice Reaction Time. The subject is f 
confronted with a panel containing a central ( 
light. He has two levers, one for the right : ‘ 
hand and one for the left hand, and two foot i 
pedals. He responds appropriately to any of | = _ j 
four stimuli as follows: s 

red light—right lever forward I 
re green light—left lever back I 
buzzer—right pedal depressed 
bell—left pedal depressed T 

- The subject is allowed 3 seconds in which to id 
respond. The central light extinguishes when - r 

the correct response is made. ‘ 

t 

t 

1 

33. Complex Coordination Test. The sub- a, 
ject is required to make motor adjustments of 
an airplane-type stick and rudder in response | nee 
to successively presented visual patterns. A 
correct response (movement of stick and rud- 
der controls to proper positions) is not accom- : 
plished until both the hands and feet have j 
completed and maintained the appropriate ad- 4 
justment. A new pattern appears as each cor- . 
rect response is completed. Score is the num- - 
ber of correct responses completed in a given ' 
test period. Four 2-minute trials. Ms 

2 
je 

34. Pursuit Confusion. The subject at- 
tempts to keep a stylus on a variable speed 
target as it moves through a diamond-shaped 
slot. The task is complicated by the fact that 
the entire target area is visible only by mirror 
vision. Score (corrects) is the time-on-target 
during the six 1-minute trials. Error score is 

; the amount of time the subject is in contact 

: with the sides of the slot. to 
m 
pl 
ol 
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35. Motor Judgment. The subject is con- 
fronted by two adjacent discs rotating at a 
constant speed. Each disc has black and white 
sections on its perimeter. Between these discs 
is a pointer whose speed of rotation the sub- 
ject can control. A forward movement of this 
stick slows the pointer and a backward move- 
ment speeds up the pointer. The subject can- 
not stop the rotation of the pointer completely 
and he can exert no control over the two 
rotating discs. The subject is required to 
manipulate the control stick so as to make as 
many revolutions of the pointer as possible 
without crossing the black areas on the ro- 
tating discs. To do this properly he must in- 
tegrate his estimates of speed of each disc, 
the pointer, and his own control movements. 
Score is the ratio of the number of errors to 
the number of pointer revolutions during four 
1-minute trials. 


36. Discrimination Reaction Time. The sub- 
ject manipulates one of four toggle switches as 
quickly as possible in response to a series of 
visual stimulus patterns differing from one 
another with respect to the spatial arrange- 
ment of their component parts, e.g., position 
of a lighted red lamp relative to a lighted green 
lamp. Score is the accumulated time of re- 
sponse for four series, each series containing 
20 reactions for each stimulus pattern (sub- 
ject must respond within 3 seconds). 


37. Rotary Pursuit. The subject attempts 
to keep a prod stylus in contact with a small 
metallic target set in a rapidly revolving 
phonograph-type disc. Score is the total time- 
on-target during five 20-second trials. 
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38. Reaction Time Test. 

Visual: The subject keeps his finger on 
a button, depressing it as rapidly as possible 
in response to a single amber light before him. 
A click provides him with a ready signal be- 
fore each light stimulus is presented, with 
the fore period (between click and light) 
varying in a random order from .5 to 1.5 sec- 
onds. Score is accumulated reaction time for 
a series of 20 reactions. 

Auditory: Same procedure except that 
the response is to a buzzer. 

Jump Visual: Same procedure except 
that the subject does not keep his finger on 
the response button but keeps it on a cross 6 
inches from the response button. He must 
move his hand to the button as rapidly as 
possible as each light stimulus appears. 

Jump Auditory: Same except response 
is to buzzer. 


39. Steadiness Aiming. The subject must 
keep a delicately balanced stylus centered in a 
small hole. Any contact with the sides of the 
hole is recorded on a clock. The score is the 
number of seconds in contact. Six 40-second 
trials. 


40. Single Dimension Pursuit. The subject 
makes compensatory adjustments (in and out 
movements) of a control wheel in order to 
keep a horizontal line in a null position as it 
deviates from center in irregular fashion. The 
control wheel is damped pneumatically, intro- 
ducing a lag into the system. Score is the 
time the horizontal line is held in a null posi- 
tion during the four 1-minute trials. 
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41. Rate Control. A _ vertical target line 
moves back and forth across a curved scale 
with frequent changes in direction and rate 
of movement. The subject attempts to keep 
a thin pointer in coincidence with this line by 
adjustive rotary manipulations of a knob con- 
trol. Score is the total time the pointer and 
target line are in coincidence during. eight 
1-minute trials. 


42. Rotary Aiming. The task is to strike at 
a series of buttons arranged in a circular pat- 
tern on a horizontal panel, going from one but- 
ton to the next as rapidly as possible. Score 
is the number of strikes in four 30-second 
trials. 


43. Rudder Control. 

Center Target: The subject sits in a 
mock airplane cockpit which he attempts to 
keep aligned with one of three target lights 
as they come on in front of him. His own 
weight throws the seat off-balance unless he 
applies and maintains proper correction by 
means of foot pedals. In this condition only 
the center target is used. Score is the total 
time the cockpit is held aligned with the cen- 
ter light during three 30-second trials. 

Triple Target: Same _ procedure as 
above except the subject must utilize appro- 
priate pedal control to shift the cockpit from 
one light to another as these come on at ran- 
dom intervals. Score is the total time the 
cockpit is lined-up with the proper light dur- 
ing three 112-second trials. 
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3L0CK DIAGRAM OF TRACKING DEVICE 
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UNROTATED Factor LOADINGS 


FACTOR 


VARIABLE N. | WV XxX XM XIV XV 
1 60 -2 04 -0 -15 -Ol -04 08 10 21 -17 -05 09 05 05 ‘55 


13 14 05 02 -02 0 -09 11 09 22 -08 -03 45 


Aerial Orientation 
~ Complex Movements 


8 


| 


Directional Control 4 50 03 21 13 Il 23 16 02 -17 -14 06 06 47 
Discrimination Reaction Time 5 il OF 2 17 +08 13 -16 15 -Ol 17 -05 47 
Following Directions 6 40 -31 21 il -05 07 0 -0 -19 10 12 02 -04 -03 15 4 
_ Forced Landings 7 54 -03 12 12 09 O1 15 -08 -02 -9 -% OF SIP 
General Mechanics 9 64 -19 -13 -19 00 -28 -10 05 -10 -08 04 -13 -15 13 66 
Instrument Comprehension 10 70 -25 05 06 -Ol 00 09 03 -Ol -10 -12 Ol 61 
Mechanical Comprehensio! 60 -33 O06 -15 -Ol -18 -18 05 04 OO -02 -03 -17 -15 07 62 
Planning A Course 15 04 03 -12 27 03 -16 05 52_ 
‘Signal Interpretation 49 -22 08 O1 09 27 22 O2 OF -14 16 -11 -12 
__ Spatial Orientation 15 45 09 _10 15 0 09 -13 -06 -28 -04 -14 05 06 15 -03 40 
_ Speed of Identification 16 41 13 23 36 -09 -O07 18 O1 -24 -02 17 -17 -11 -03 04 54 a 
Stick and Rudder Orientation 17 64 -35 -02 -19 00 07 -22 -Ol_ 12 08 -13 08 09 7 -O2 68 4 
Vocabulary 18 22 -35 31 -34 -38 O1 -19 14 07 -06 -10 -06 -04 -13 63 
‘Visual Pursuit 19 61 -05 -Ol 10 02 12 -10 -22 16 12 02 -Ol -15 Ff | 
Visualization of Maneuvers -07 -07 -02 -14 05 16 03 62 
“Finger Dexterity 21 25 30 -09 19 18 -19 -16 -03 10 18 -Ol -08 -12 -27 42 
Purdue Pegboard 22. «40 S15 03 6 S02 S16 S03 _ 
Rate of Manipulation (placing) 23 14 51 -05 37 05 -12 01 
~ Rate of Manipulation (turning) 24 28 45 -ll 26 -04 -06 -13 -08 -04 -03 -27 11 01 -12 00 4 | | 
Two Plate Tapping 2 25 «445 -08 16 -12 -Ol -03 12 08 02 -24 -O1 06 06 42 
"Precision Steadiness (errors) 26 40 20 04 -08 08 -ll 08 20 -13 23 15 05 -07 03 14 3 F | 
“Control Sensitivity ||| 28 39 35 O08 02 Il -O2 -12 -31 -04 -15 14 Si 
~ Ten Target Aiming (correct) 30 18 46 20 -ii -35 17 -23 28 -03 09 12 16 02 -05 -Ol 6 fF 1 
Bimanual Matching 15 ~-10 01 11 15 08 -07 -02 -03 -06 08 06 42 
Pursuit Confusion (errors) 36. 50 -02 -33 -02 O1 02 -16 11 -09 16 15 13 Of | | 
“Pursuit Confusion (correct) 48 -29 -10 -06 03 07 -23 08 -18 10 17 -15 -05 -04 
Discrimination Reaction Time 39 52 18 10 -03 14 09 -03 -03 15 -24 14 03 04 07 05 45 ai 
“Rotary Pursuit 40 43 24 -34 -04 -16 -09 -% 06 16 O09 11 -09 09 O02 2 Si 
__ Visual Reaction Time 4. -03 28 44 -14 +17 -02 17 12 2) OF 01 OF 15 O1 45 
~ Auditory Reaction Time _ a2 09 2% 35 -17 2 03 03 -0 11 12 -13 05 -07 -18 O1 40 L 
Jump Visual Reaction Time 3836-14 12. 03 -18 -28 00 -04 16 OO 04 OF 15 49 
~ Jump Auditory Reaction Time 44 22 33 31 -32 24 05 = 
Steadiness Aiming 45+ OB 
“Single Dimension Pursuit -09 -14 -Ol -13 -32 -04 00 05 -OR 12 05 2 a 
: ~ Current Affairs 50 09 -29 33 21 -25 -#l 15 -12 02 -05 04 23 08 09 06 59 a 
Note.—Decimal points have been omitted. 
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PREDICTORS OF COMPLEX TRACKING BEHAVIOR 
APPENDIX H 
ROTATED Factor LOADINGS 
FACTOR 
VARIABLE N. | Ww vow ix x xt XI XIV XV he 
55 | Aerial Orier 1 52 0 -Ol 08 -12 2 05 05 -O2 2 2% -ll 13 -7 53 
5 49 | — Coordinate Movements 3 36 OO -0 il 15 2 19 -Ol 03 18 40 06 14 04 -03 47 
6 47 Directional Control 34 +13 -16 05 08 13 27 O1 OF 30 -1l1 17 20 -12 
0 47 Discrimination Reaction Time 5 07 30 -10 15 14 20 38 -06 14 13 25 04 02 -04 17 45 
5 al ~ Following Directions 6 27 -10 -Ol 02 05 23 06 O04 31 09 27 06 20 -16 -08 40 
0 51 [| — Forced Landings 7 29 12 -3 O OF il 36 O08 O4 13 10 -03 35 20 -15 48 
9 71 ~ Formation Visualization 8 33 -11 -03 -03 -05 18 15 15 20 61 19 -06 18 04 12 70 
1 61 Instrument Comprehension 10 47 #09 -16 O02 -Ol 24 2 08 15 33 14 OO 16 -05 13 
7 62 | Mechanical Comprehension 11 32 -03 07 -06 -05 21 -02 11 04 38 17 -0 47 03 12 S58 
6 67 | Pattern Comprehensi 12,16 -08 
5 52 Planning A Course _ 31 -0 3 7? 3 0 2 3 2 -16 -16 
40 | Spatial Orientati 34 10 02 2 10 0 05 30 24 -Ol 10 -03 06 04 38 
54 | Speed of identification | 16 09 17 -05 15 16 20 23 08 53 06 13 -10 14 10 00 53 
2 68 ~ Stick and Rudder Orientation 17 53 -04 05 02 -ll 16 03 O1 -12 57 2 OF 7 -03 4 7 
3. 63 | — Vocabulary 18-18 -18 13 -04 -12 67 05 -03 08 15 -02 -0 il 13 02 60 
5 Visual Pursuit 35 03 OO O7 OF -Ol 13 -02 3 14 33 14 16 16 18 
3 «62 Visualization of Maneuvers 4 08 07 OS -16 16 16 -08 2) 47 16 13 -07 O1 
7 42 ~ Finger Dexterity 2. -08 07 -03 04 05 -Ol -02 05 18 13 17 OO 05 49 16 36 
52 Purdue Pegboard 4 33 -13 33 #15 -04 -02 14 16 09 06 -10 43 
4 50 _ Rate of Manipulation (placing) -13 38 2 00 -0 -02 03 -10 -09 -06 36 
0 49 | Rate of Manipulation (turning) 24 8 33 -13 40 18 -02 -10 -07 05 06 -10 0 04 27 19 47 
6 42 ~ Two Plate Tapping 14 41 -05 35 08 -O04 04 04 -O4 -O5 -07 -13 -02 17 12 38 
4 39 | Precision Steadiness (errors) 26 20 22 06 -Ol 13 -06 -05 34 16 -Ol 28 -08 14 08 08 37 
4 47 Direction Control 
451 Control Sensitivity 2 13 38 10 13° 2 OO 17 14 O06 -19 O1 2 24 50 
Target Aiming (errors) 29 -06 07 63 35 04 15 -13 -09 14 03 
6 42 | Bimanual Matching 31. 
7 4h ~ Track Tracing (errors) 32 21 29-03 -06 04 =C-0l 10 42 09 10 16 oo -02 18 20 
8 54 | Complex Coordinator 35 34 08 
451 |  PursuitConfusion (correct) 17 +38 -ll 05 13 -08 -Ol 15 05 35 28 18 16 
27_-| Motor Judgment 14 2 -0 15 -04 02 -14 04 17 -04 13 20 27 
5 45 Reaction Time 39 14 28 O1 29 04 2 -Ol 34 15 08 08 
4 51 ~ Rotary Pursuit 40 17 60 -02 -0 -04 O01 00 -05 12 27 -14 08 04 12 53 
1 4 ~ Visual Reaction Time 4-08 -07 13 03 48 05 15 21 -22 -16 O7 -16 -13 -02 09 46 
= Auditory Reaction Time 42. 12-14 O07 51 -04 12 -20 -09 O1 -05 10 16 05 
49 _ Jump Visual Reaction Time 03. 13+ «36 
> Jump Auditory Reaction Time 44 26 48 20 _ 
l Steadiness Aiming 45 02, 08s «08 
Bo “Single Dimension Pursuit (46 15 15 19 -06 10 07 -05 -2% 12 il -Ol 08 -03 10 20 25 
30 | Rotary Aiming 48 -03 -Ol 02 12 2 09 -09 03 08 -21 -21 -14 OF 2 
Current Affairs 50 -02 O7 -02 O1 -03 67 -04 19 15 -05 -Ol 19 -08 -12 S58 
“Integrated Error Score 1 51-20-05 +04 02 «02 
Integrated Error | Score 2 2 A ® 2 og -06 12 #10 
“Integrated Error Score 3 53. 14 02 O07 09 O05 14 O08 -ll 14 06 16 09 
Integrated Error Score 5 55 30 11 -02 08 O1 13 22 12 -Ol 06 04 10 -06 18 
Integrated Error Score 6 56 25 12 04 #10 10 15 OF -0 00 10 OF 12 
“Integrated Error Score 7 57 14 08 1 -O7 O04 18 13 -08 13 03 O07 08 02 OO 2 21 
“Integrated Error Score 8 58 16 10 09 -O7 O7 14 12 -03 00 13 12 14 00 -04 22 
~ Integrated Error Score 9 59 18 03 08 -04 18 18 ii -03 03 09 10 21 10 13 22 
Integrated Error Score 10 60 11 06 O05 12 18 03 -10 -09 0 03 14 17 29 24 
Horizontal Error Score 61 19 05 -03 038 16 -0 -16 -0 % O1 0 OF -Oh 
_ Horizontal Error Score 2 62. 05 «06 -02 -Ol 09 10 05 -04 -02 04 -05 -05 Ol 01-03 04 
“Horizontal Error Score 3 63 09 13 02 02 -04 13 21 02 -06 13 10 -06 -09 05 -Ol 13 
Horizontal Error Score 4 18 05 05 -07 16 23 -10 -18 _18 
Horizontal Error Score _5 65 14 12 -02 -05 05 21 il -04 07 -04 -06 21 16 
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APPENDIX H—Continued 


FACTOR 


VARIABLE N. | Ww WwW xX xt XIV XV 
~ Horizontal Error Score 66 21 14 10 16 06 04 OO OF O04 13 -02 09 -ll 13 16 


~ Horizontal Error Score _ 


6 

7 = —- 
~ Horizontal Error Score _ 14 00 -05 02 10 00 038 04 Ol 7-07 20 


~ Horizontal Error Score 69 13 12 04 -05 19 06 -0 19 04 -10 08 10 03 02 16 16 


“Horizontal Error Score 10 70 19 -Ol 03 -07 10 09 -ll -15 04 02 OO 10 03 -Ol 2% 7 
1 


71 20 0 -10 08 2 10 -03 -03 -02 08 10 -15 -3 4 


72 17 -02 06 03 16 02 OO O1 05 -08 OO 15 10 


Vertical Error Score 


~ Vertical Error Score 


2 
Vertical Error Score 3 73 O7 09 05 00 16 O09 -05 09 09 09 OO 08 06 

4 

5 


74 13 08 03 -03 06 06 24 08 -03 05 i7 05 -09 -15 05 16 
75 18 18 -08 10 04 05 19 16 -10 10 02 -02 -03 -03 15 19 


Vertical Error Score 


Vertical Error Score 


Vertical Error Score 6 7 09 “4 17 10 13-01 06 10 -Ol 068 -04 


Vertical Error Score 7810 04 -03 O1 00 -Ol 12 02 O7 13 08 o2 oO Il 


Vertical Error Score 9 79 O1 04 O02 -O2 04 13 Wl -10 -04 -02 18 04 16 0 16 13 


Vertical Error Score 10 80 10 05 -02 -03 05 15 -06 -19 OO 03 -08 08 10 03 2 16 


Sideslip Error Score 81 12 04 -Ol 13 09 11 O89 02 O02 18 -O7 09 1 


~ Sideslip Error Score 


2 
~ Sideslip Error Score 3 83 03 -10 06 -03 O1 -06 -19 O1 10 -07 09 05 15 O1 -O1 10 
Sideslip Error Score 4 


ie 82 08 -08 -04 02 -08 16 -05 03 14 -03 O1 02 08 -15 -O1 09 


sides 84 05 -08 -02 -03 -05 O1 -10 -03 13 O1 -07 0 OO -05 li 06 
“‘Sideslip Error Score 5 85 06 15 02 08 -20 -04 04 -O1 -03 19 10 OO 06 14 
~ Sideslip Error Score 6 8% o9 03 08 05 -05 18 -Ol -06 -O7 04 -10 27 O01 03 05 15 


~ Sideslip Error Score 4 8 11 -0 08 02 15 20 17 -03 00 06 O08 22 -O4 O1 16 19 


~ Sideslip Error Score 9 12 Ol 12 -03 12 OF 17 05 08 09 19 14 15 2 


~Sideslip Error Score 10 90 03 10 05 -l1 13 16 10 -12 -05 05 -Ol 19 ii -Ol 24 20 


Time-On-Target Score 1 91 2 06 OO 05 08 05 -16 -Ol 13 12 -21 -03 19 


92. 11 08 01 03 05 ‘10-0105 11 -08 08 


Time-On-Target Score _ 


93 17 +12 +03 -Ol Of O7 21 -Ol 08 07 12 -02 06 13 


~ Time-On-Target Score 


~ Time-On-Target Score 5 95 30 14 -Ol 02 06 O02 25 17 -O08 06 -02 -05 00 -O7 21 26 
5 
7 


~ Time-On-Target Score % 2 12 OF 06 15 10 10 O Ol 13 -O7 19 23 


97 19 10 O05 10 13:12 


Time-On-Target Score 11 -06 08 18 15 02 i1 13 2 03 -02 22 23 
Time-On-Target Score 9 7 8 6 4 15 if 


—Time-On-Target Score 10 100 25 05 03 19 17 -03 -19 -08 06 06. 13 16 05 30 


Note.—Decimal points have been omitted. 
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